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A meta-analysis of the effect of episodic future thinking on delay discounting 


Abstract 


Delay discounting (DD) is the phenomenon that individuals prefer to choose an 
immediate but smaller reward than a delayed but larger reward. Larger DD is 
considered as an indicator of impulsivity, the increased DD rate is also seen as a 
behavior indictor of various psychiatric disorders. Episodic future thinking (EFT) is the 
ability to project oneself into the future to pre-experience the future events, which can 
be used to reduce DD. The present study provided a meta-analysis on the efficiency of 
EFT in reducing DD and examined potential moderators. Thirty-seven studies including 
48 contrasts were included, results showed that EFT reduced DD significantly. 
Moderator and meta-regression analyses revealed that positive EFT was more efficient 
in reducing DD. In addition, several factors related to DD task (e.g., whether the DD 
money is hypothetical or potential real, whether the delay reward is fixed or variable, 
and the indexes of DD) were related to the efficiency of EFT in reducing DD. These 


results have implications for using EFT to reduce DD in the future. 
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Introduction 


In daily life, people often need to make choices between short-term and long-term 
rewards such as choosing to enjoy the smoking for now or stop smoking and keep 
healthy in the future (Lempert & Phelps, 2016). During decision-making, people tend 
to discount the value of future rewards, i.e., they prefer to choose an immediate but 
smaller reward than a delayed but larger reward (Logue, 1988). The phenomenon that 
the subjective value of future rewards is reduced over time is known as delay 
discounting (DD), also called time discounting or temporal discounting (Frederick, 
Loewenstein, & O'Donoghue, 2002; Sellitto, Ciaramelli, & di Pellegrino, 2011). DD is 
considered as an indicator of impulsivity, the increased DD rate is also seen as a 
behavior indictor of substance addiction (de Wit, Flory, Acheson, McCloskey, & 
Manuck, 2007; Rung & Madden, 2018). In fact, increased DD rate is highly associated 
with many maladaptive behaviors such as smoking (MacKillop et al., 2011), alcohol 
addiction (Bobova, Finn, Rickert, & Lucas, 2009), and gambling problems (Reynolds, 
2006). It is also a transdiagnostic process in psychiatric disorders, a meta-analysis 
demonstrated that increased DD has been observed in psychiatric disorders including 
major depression disorder, schizophrenia, bipolar disorder and eating disorders 
(Amlung et al., 2019). Given DD is a relatively stable characteristic of individuals and 
its association with unhealthy behaviors and psychiatric disorders, a growing body of 
studies have examined ways to reduce DD rate and change maladaptive behaviors 
(Scholten et al., 2019). 


Two studies have summarized different types of manipulations or trainings used to 


decrease DD (Rung & Madden, 2018; Scholten et al., 2019) including mindfulness- 
based interventions (Hendrickson & Rasmussen, 2017; Yao et al., 2017), contingency 
management (Giles, Robalino, McColl, Sniehotta, & Adams, 2014; Stanger, Budney, & 
Bickel, 2013), acceptance and commitment therapy (Morrison, Madden, Odum, & 
Twohig, 2014), visualization training (Parthasarathi, McConnell, Luery, & Kable, 
2017), and episodic future thinking (EFT) (Bulley & Gullo, 2017) etc. However, for the 
majority of these methods, the effect to reduce DD rate was mixed. Of these methods, 
EFT is a promising manipulation to decrease DD rate (Scholten et al., 2019). EFT has 
been widely investigated and is considered to be a potentially effective manipulation in 
clinical settings and may have a long-term effect on DD (Boot, Simons, Stothart, & 
Stutts, 2013; Stein, Tegge, Turner, & Bickel, 2018). 

EFT is the ability to project oneself into the future to imagine and pre-experience the 
future events (Schacter, Addis, & Buckner, 2007; Schacter, Benoit, & Szpunar, 2017). 
EFT plays an important role in daily lives and is engaged in adaptive behaviors 
including far-sighted decision-making, emotion regulation, etc. (Brocas & Carrillo, 
2018; Schacter et al., 2017; Schacter & Madore, 2016). 

To examine the effect of EFT on DD, participants were asked to imagine future 
events before making choices (Bulley et al., 2019; Stein et al., 2018). Most studies 
found that EFT reduced DD in healthy individuals (Scholten et al., 2019) and special 
populations such as smoker (Chiou & Wu, 2017), obese individuals (Daniel, Stanton, 
& Epstein, 2013a), and alcohol abuse individuals (Snider, LaConte, & Bickel, 2016). 


In addition to reduce DD rate, EFT also works on behavioral indicators, such as 


reducing demand of cigarettes (Stein et al., 2016), alcohol demand intensity (Bulley & 
Gullo, 2017), calory intake (Daniel, Stanton, & Epstein, 2013b) and so on. 

Generally, EFT is effective in reducing DD. However, there are a few studies failed 
to find an effect of EFT on DD (Hu et al., 2017; Liu, Feng, Chen, & Li, 2013; Palombo, 
Keane, & Verfaellie, 2016; Zhang, Peng, Qin, Suo, & Feng, 2018). Liu et al. (2013) and 
Zhang et al. (2018) found that compared with control condition, negative EFT could 
not reduce DD rate, and even increased DD rate. Palombo et al. (2016) and Hu et al. 
(2017) found that EFT reduced DD in healthy participants effectively, but not in 
amnestic patients. For those studies showing an effect of EFT on DD, the effect size 
varied a lot, ranging from 0.26 to 1.49 (Hollis-Hansen, O'Donnell, Seidman, Brande, & 
Epstein, 2019). This might be because there are large variations regarding the study 
characteristics, including EFT related factors, control task related factors, DD task 
related factors, and participants related factors. 

For EFT related factors, the emotional valence of EFT may be associated with its 
effect on DD (Liu et al., 2013). Positive EFT reduced DD while neutral and negative 
EFT had no effect of DD, and even increased the DD rate (Zhang et al., 2018). In 
addition, the method to elicit EFT was different, widely used paradigms included cue 
word task (Bulley et al., 2019) and autobiographical interview (Ciaramelli, Sellitto, 
Tosarelli, & di Pellegrino, 2019) . As for cue word task, participants were given cue 
words to imagine future events (Bulley et al., 2019). While in autobiographical 
interview, participants were asked to imagine future events that may happen in a 


specific time period (this method is referred as the time period task below) (Daniel, 


Said, Stanton, & Epstein, 2015). It remains unknown whether the different method to 
elicit EFT would affect its effect on DD. 

When examining the effect of EFT on DD, studies used different control tasks as the 
comparison condition. For example, some studies used episodic recent thinking as the 
control task, i.e., participants were asked to recall events happened within the past 24 
hours before making choices (Daniel et al., 2015; Daniel, Sawyer, Dong, Bickel, & 
Epstein, 2016), some studies used other types of control task such as story-telling or 
imagining routine events (Bulley & Gullo, 2017; Bulley et al., 2019), while some 
studies did not require participants to image or recall any event, just to complete the 
DD task directly in the control condition (Sasse, Peters, Buechel, & Brassen, 2015). 
Whether different contents of the control condition lead to different degrees of DD 
reduction is not yet known (Scholten et al., 2019). 

Furthermore, the DD task used in previous studies varied from study to study. For 
example, the largest reward ranged from 100 (Hollis-Hansen et al., 2019; O'Donnell, 
Daniel, & Epstein, 2017; Rung & Madden, 2019) to 2000 (Mok et al., 2020). DD rate 
decreased in larger magnitude of reward compared to smaller magnitude of reward 
(Green & Myerson, 2004; Kwan et al., 2012), however, whether the effect of EFT on 
DD rate varied with the magnitude of reward was less studied (Jia et al., 2020). Besides, 
there was a great variation of delay time in the DD task, the longest delay of delayed 
reward ranged from 7 days (Cheng, Shein, & Chiou, 2012) to 25 years (Stein et al., 
2017). The delay time may be a potential variable that influence the effect of EFT on 


DD. 


Another group of factors was related to participants, i.e., age of participants and 
population of participants (general healthy participants vs. special population such as 
smokers). EFT significantly reduced DD rate in young adults (Mok et al., 2020). Sasse, 
Peters, and Brassen (2017) found that imagining a scene interacting with another person 
did not reduce DD rate in older adults. Mok et al. (2020) suggested that the effect of 
EFT on DD rate was smaller in older adults than in young adults. In addition, EFT was 
found to reduce DD in different participant groups including healthy individuals 
(Scholten et al., 2019) and special populations such as smokers, obese individuals, and 
cannabis use disorders (Chiou & Wu, 2017; Daniel et al., 2013a; Sofis, Lemley, Lee, & 
Budney, 2020), whether EFT showed a differential effect on DD in different populations 
remained unknown. We took these factors as moderators in the meta-analysis. 

Overall, there is growing attention on approaches to reduce DD, no study has 
systematically examined which factors affect the efficiency of EFT on DD. The present 
study aimed to provide a meta-analysis to examine this issue, we considered four groups 
of factors, including EFT related factors, control task related factors, DD task related 
factors, and participants related factors, and examined whether these factors moderate 


the effect of EFT on DD. 


Method 


Literature search 


A literature search in Web of Science, Google scholar and Springer were conducted 


with the following keywords: (*delay discounting" OR "temporal discounting" OR 
"time discount*" OR "intertemporal choice" OR "inter* decision making") AND 
("future thinking" OR “prospection” OR "episodic future thinking" OR "episodic future 
thought" OR "imagining the future" OR "episodic simulation" OR "future envisioning"). 
The literature search was from 1990 to June 11, 2020. 

The literature search was restricted to peer-reviewed papers published in English. A 
total of 1954 potential papers were identified from the literature search and additional 
28 papers were identified through reference lists from review articles. After excluding 
irrelevant articles based on title and abstract and removing duplications, 65 papers 
remained for further consideration. Next, studies were included if the following criteria 
were met: a) Full-text articles were available (not conference abstracts); b) They were 
empirical studies, not reviews, comments, or meta-analyses; c) Studies were not case 
studies; d) Studies measured how EFT impact DD; e) Studies reported sufficient data 
to calculate effect sizes. For the studies fulfilling previous criteria but without sufficient 
data to calculate effect sizes, we contacted the authors to provide additional data. If no 
further data were provided, the studies were excluded from the final analysis. Finally, 
37 papers including 48 contrasts were included in the meta-analysis. The flow of 


literature screening is shown in Fig. 1. 


INSERT FIG 1 HERE 


Data extraction 


For each included paper, the following data were extracted: First, the basic 
information of a study, including the first author and the year of publication; the sample 
size and mean age of participants, type of participants (healthy participants, special 
populations). Second, data for calculating effect sizes of EFT on DD. For between- 
subject design studies, mean and SD on measures of DD were extracted; if mean and 
SD were not available, other data that could be used to calculate effect sizes such as t- 
values and sample sizes were extracted. For within-subject design studies, paired t- 
values, sample sizes and mean were extracted. Nine studies included more than one 
experiments or different groups of participants, we calculated a separate effect size for 
each experiment or contrast for these papers. If several studies had a large overlap of 
participants, we just included one of these studies. For example, these two studies have 
large overlap in patients (Palombo, Keane, & Verfaellie, 2015; Palombo et al., 2016), 
we only include the former paper when calculating effect size in patients. Sofis et al. 
(2020) included DD for gains and DD for losses, since all other studies were on DD for 
gains, we just included DD for gains in the present meta-analysis. Third, moderatos 
were recorded for moderator analysis or meta-regression analysis. Moderators were 
mainly classified to four types. (1) EFT related moderators included: the valence of 
EFT; the method used to elicit EFT (e.g., participants were given cue words to generate 
EFT or participants were asked to imagine events that may happen during a specific 


period); the context of EFT (e.g., personally relevant EFT or task-related EFT. For 


! [f participants were asked to imagine future events happen in a specific time period during cue generation, then 
cue words were extracted from these events, and these cue words were provided for EFT during the DD task, these 
studies were categorized as the cue word task type (Bromberg, Lobatcheva, & Peters, 2017). 


personally relevant EFT, participants were asked to imagine personally relevant future 
events but not related to rewards regarding the DD task; for task-related EFT, 
participants were asked to imagine events which were related to the reward such as 
spending money at the delayed time); the longest delay in EFT was also included as a 
moderator. (2) Control task related moderators included: the context of control task (e.g., 
no control task, recalling past event, other types such as story-telling or routine events); 
the valence of control task; and the longest time distance in the control task. (3) DD 
task related moderators included: the reward type (e.g., hypothetical or potential real. 
Hypothetical reward means participants would not receive extra reward no matter what 
they choose in the DD task; potential real reward means participants may receive some 
reward based on their choice); the DD task type (e.g., whether the choices were prefixed 
or the choices varied based on participants’ responses’); the immediate reward type 
(whether the immediate smaller reward changed or was fixed); the delayed reward type 
(whether the delayed larger reward changed or was fixed); the outcome indexes of DD 
(e.g., area under the curve [AUC], K [including k-value, log k value and In k value], 
proportion of choosing larger later reward, indifference point); the longest delay in DD 
task; and the largest amount of reward in the DD task. (4) Participants related 
moderators included: age of participants, and population (healthy individuals or special 


populations). 


Data analyses 


? One example of the former task is the Monetary Choice Questionnaire(Bulley et al., 2019), an example of the 
latter task used titration algorithm to calculate the amount of reward in the DD task (Ciaramelli et al., 2019). 


The data were analyzed using Comprehensive Meta-Analysis (version 2.0) 
(https://www.meta-analysis.com/); Cohen's d was used as the index of effect size. We 
first examined the overall effect size of EFT on DD. We then examined whether the 
effect of EFT on DD performance was related to the following variables using 
moderator analyses or meta-regression: 1) The valence of EFT ; 2) The method used to 
elicit EFT; 3) The context type of EFT; 4) The longest delay of EFT; 5) The context 
type of control task; 6)The valence of control task; 7) The longest time distance of 
control task; 8) The DD reward type; 9) The type of DD paradigm; 10) The immediate 
reward type; 11) The delay reward type; 12) The outcome index of DD; 13) The longest 
delay of DD; 14) The largest amount of money reward of DD; 15) The age of 
participants; 16) the population of participants. 

We reported the heterogeneity of the studies with Q statistic, if the heterogeneity was 
significant, we adopted the random-effects model to report effect sizes; otherwise, we 
reported results using the fixed-effects model. The moderator analyses adopted the 
random-effects model. All significance levels were set at p « 0.05 (Hedges & Vevea, 
1998). Publication bias was examined with the fail-safe N analysis, which indicated the 


number of studies with null results needed to reject the present significant findings. 


Results 
Overall effect size of EFT on DD 
The final analysis included 37 studies including 48 contrasts to examine the effect of 


EFT on DD. Table 1 provides a summary of these studies. The mean effect size 


(Cohen's d) of EFT in reducing DD was 0.58, the 95% confidence interval was 0.45 to 
0.71, suggesting that EFT manipulations can reduce DD with a medium effect size (see 
Fig. 2). These studies were heterogeneous (Q=201.69, p«0.001). Publication bias 
analysis revealed that at least 4054 studies with null results were needed to reject the 
present results, which is much larger than the number of contrasts included in the 
analysis (N=48), suggesting that publication bias was not likely to explain the 


significant results. 


INSERT TABLE 1 AND FIG 2 HERE 


Moderator and meta-regression analyses 
EFT related moderators 
The effect of EFT valence 

Positive EFT reduced DD (k=27, d=0.78, p<0.001), EFT with valence not 
particularly mentioned reduced DD (k=12, d=0.44, p«0.001), positive or neutral EFT 
reduced DD (k=4, d=0.57, p=0.010), negative EFT (k—4, d=-0.05, p=0.910) or neutral 
EFT (k=3, d=0.41, p=0.276) did not reduce DD. Considering the number of studies, we 
only included studies with positive EFT and EFT with valence not mentioned in the 
moderator analysis, results indicated that the moderator effect of EFT valence was 
significant (Q=5.80, p=0.016), suggesting positive EFT had a larger effect (see Table 


2). 


INSERT TABLE 2 HERE 


The effect of method to elicit EFT 
Both methods to elicit EFT reduced DD: cue word task (k—17, d=0.36, p=0.004), 
time period task (k—27, d=0.72, p«0.001). Time period task showed larger effect in 


reducing DD than cue word task. (Q=5.86, p=0.016) (see Table 2). 


The effect of context type of EFT 
Both personally relevant EFT (k=41, d=0.59, p<0.001) and task-related EFT (k=7, 
d=0.52, p=0.004) reduced DD. The two context types of EFT showed similar effect on 


DD (Q=0.25, p=0.616) (see Table 2). 


The effect of longest delay in EFT 

Based on the longest delay, we divided the studies into three groups: no more than 
180 days (x180 days), between 180 and 365 days (180<X<365 days), more than 365 
days (> 365 days). Results demonstrated that EFT reduced DD irrespective of the length 
of delay: longest EFT delay no more than 180 days? (k=7, d=0.75, p<0.001), between 
180 and 365 days (k=17, d=0.71, p<0.001) and more than 365 days (A=12, d=0.61, 


p<0.001), there was no significant difference among these groups (Q=0.95, p=0.623). 


Control task related moderators 


3 The longest EFT delay was 180 days for all studies in this group. 


The effect of context type of control task 

EFT showed medium effect sizes with all types of control task (no control task, k=18, 
d=0.40, p=0.003; past event, k=19, d=0.67, p«0.001; other types such as story-telling 
and routine event, k=15, d=0.60, p«0.001). There was no significant difference among 


the three types of control task (Q=2.86, p=0.239). 


The effect of control task valence 
EFT reduced DD in studies with either positive control task (k=13, d=0.75, p<0.001) 
or control task with valence not particularly mentioned (k=34, d=0.51, p«0.001). The 


valence of control task did not influence the EFT effect on DD (Q=3.46, p=0.063). 


The effect of longest time distance of control task 

In 14 contrasts, the control task did not mention time distance, EFT reduced DD in 
these studies (d=0.61, p<0.001); in 20 contrasts, the control task mentioned the time 
distance, EFT reduced DD in these studies (d=0.66, p<0.001). These two groups of 
studies did not show a significant difference on EFT effect (Q=0.10, p=0.758). 

For those studies mentioned time distance in the control task, we further divided the 
time limit of control event into those happened within 24 hours or over 24 hours (x24 
hours, k=9, d=0.55, p«0.001; > 24 hours, k=11, d=0.72, p<0.001), these two groups of 


studies showed similar effect (Q=1.42, p-0.234)*. 


^ [n these studies, all studies but one asked participants to recall past events in the control task, while one study 
(Lin & Epstein, 2014) asked participants to imagine events that may happen in the next 24 hours in the control 


DD task related moderators 
The effect of DD reward type 

When the reward was hypothetical, EFT reduced DD (k=36, d=0.68, p«0.001), when 
the reward was potentially real, EFT did not significantly reduced DD (k—12, d=0.26, 
p=0.087). Moderator analysis revealed that there was significant difference between the 
two groups, when the reward was hypothetical, EFT had a larger effect (Q=6.32, 


p-0.012). 


The effect of DD paradigm type 

EFT reduced DD rate when the rewards were fixed in the DD task (k=20, d=0.52, 
p<0.001) and when the rewards varied depend on participants’ responses (k—28, d=0.62, 
p<0.001). Results indicated that the moderator effect of DD paradigm was not 


significant (Q=0.68, p=0.411). 


The effect of immediate reward type 
EFT reduced DD rate when the immediate reward varied (k=31, d=0.65, p<0.001) 
and when the immediate reward was fixed (k=17, d=0.46, p«0.001). There was no 


significant difference between these two conditions (Q=1.89, p=0.170). 


The effect of delayed reward type 


condition, if we delete this study, the results remained similar (Q=1.26, p=0.261, <24 hours, k=8, d=0.55, 
p<0.001; > 24 hours, k=11, d=0.72, p<0.001) . 


EFT reduced DD rate when the delayed reward varied (k—27, d=0.42, p<0.001) and 
when the delayed reward was fixed (k—21, d=0.78, p«0.001). There was a significant 
difference between these two conditions, the EFT effect on DD was larger when 


delayed reward was fixed (Q=8.29, p=0.004). 


The effect of outcome index of DD task 

Studies used indexes of AUC (k—22, d=0.73, p<0.001) and K (including &-value, log 
k value and In k value) (k=19, d=0.47, p«0.001) showed significant effect of EFT in 
reducing DD. Other indexes included radio of choosing larger later reward, radio of 
choosing smaller sooner reward, indifference points, studies using these indexes also 
exhibited a significant effect of EFT in reducing DD (k=12, d=0.42, p«0.001). 
Considering the great heterogeneity of other indexes, we just compared the indexes of 
AUC and K, the moderator effect was significant, the EFT effect on DD was larger 


when AUC was used as the index (Q=3.98, p=0.046). 


The effect of longest delay in DD task 
EFT reduced DD irrespective of the longest delay in the DD task (< 180 days, k=8, 
d=0.45, p=0.033; 180<X<365 days, k=22, d=0.56, p<0.001; > 365 days, k=15, d=0.79, 


p<0.001), there was no significant difference among these studies (Q=4.21, p=0.122). 


The largest amount of reward in DD task 


EFT reduced DD rate in both small reward («100, &—25, d=0.55, p<0.001) and large 


reward (7100, k=23, d=0.68, p<0.001) conditions, there was no significant difference 


between these conditions (Q=1.16, p=0.281). 


Participants related moderators 
The effect of age 

EFT reduced DD rate in all age groups (<18 years old (k—2, d=0.74, p=0.004), 
18<X<40 (k=37, d=0.56, p«0.001), 40<X<60 (k=3, d=0.91, p«0.001), >60 (k=6, 
d=0.40, p=0.002)). Results indicated that the moderator effect was not significant 
(Q=4.21, p=0.240). However, the numbers of studies for children or adolescents (<18 
years old) (N=2) and participants between 40 and 60 years old (40<X<60, k=3) were 
limited. We further divided studies into two groups: no more than 40 years old (A=39, 
d=0.58, p<0.001) and over 40 (k=9, d=0.60, p<0.001), the moderator effect was still 
not significant (Q=0.02, p=0.898). Furthermore, meta-regression analysis revealed that 


age was not significantly related to EFT effect (Z=-0.69, p=0.488). 


The population of participants 
EFT reduced DD rate in both healthy individuals (k=40, d=0.59, p<0.001) and 
special populations (A=8, d=0.50, p«0.001), there was no significant difference 


between these studies (Q=0.35, p=0.355). 


Discussion 


In the present meta-analysis, 37 studies including 48 contrasts were included to 
examine the effect of EFT in reducing DD. Results indicated that EFT reduced DD with 
medium effect size (Cohen's d=0.58) and publication bias was not likely to account for 
this significant finding. Moderator analyses revealed that the EFT valence, the method 
used to elicit EFT, the reward type, the delayed reward money type and the outcome 


index of DD was significantly correlated with the efficiency of EFT in reducing DD. 


Overall effect of EFT in reducing DD 

The present meta-analysis revealed that EFT significantly reduced DD. There may 
be several potential mechanisms. 

First, according to the Construal Level Theory (Trope & Liberman, 2003), the 
concreteness of thought were related to perceived time distance (Lempert & Phelps, 
2016). The future events are more abstract and with more essential features under high 
construal level, while the present events are more concrete and detailed under low 
construal level. EFT may provide a chance for participants to transfer their 
representation of future events from high construal level to low construal level by 
imaging future event with concrete details. Through imagining and representing rich 
details, it may make the future outcomes more attractive and increase the possibility to 
choose the delayed option (Bulley et al., 2019). Previous studies also provided evidence 
that the degree of reduced DD by EFT was significantly related to the concreteness and 


vividness of EFT, the more details and vividness of imagination, the greater reduction 


in DD (Benoit, Gilbert, & Burgess, 2011; Kim, Schnall, & White, 2013; Peters & 
Büchel, 2010; Zhang et al., 2018). 

Second, EFT makes people pre-experience future events and generate anticipatory 
feelings (Suddendorf & Moore, 2011). According to Bulley, Henry, and Suddendorf 
(2016), the value and perceived likelihood of future rewards are two synergistic 
feedback factors for decision making, EFT influences these two factors to moderate the 
DD choices. For example, anticipation of future events may expand the temporal 
window which may increase tolerance for delayed rewards, people would prefer to 
choose the larger reward which brings more good feelings (Snider et al., 2016). The 
vivid EFT may let people anticipate more of the future reward and the anticipation may 
add weight to the value of delayed reward which provide a stronger motivation for goal 
pursuit (Bulley et al., 2019; Miloyan, Bulley, & Suddendorf, 2016; Renner, Murphy, Ji, 
Manly, & Holmes, 2019). Besides, the EFT may increase the perceived likelihood of 
future rewards which may increase the probability of choosing the delayed option 
(Bulley et al., 2016). 

Third, EFT may reduce DD through increasing self-control. Self-control is 
considered as an essential capacity in DD (Adele, 2013; Herrmann, Misch, Hernandez- 
Lloreda, & Tomasello, 2015). According to the self-control model, individuals would 
reconsider the delayed reward in decision-making phrase through the self-control 
system. For example, even though the immediate option has higher subjective value 
than the delayed option, individuals may still choose the latter option which has greater 


benefit, these processes were regulated by lateral prefrontal cortex which related to self- 


control function (Figner et aL, 2010). The impulsiveness reflects decreased or 
impairments in self-control (Tangney, Baumeister, & Boone, 2004). EFT may 
strengthen self-regulation to revalue the delayed reward and inhibit the impulsive 
behavior (Baumeister, 2014; Boyer, 2008; Bulley & Gullo, 2017). 

Regarding the underlying neural mechanisms, Peters and Büchel (2011) summarized 
previous studies and suggested that DD was related to three neurocognitive systems, 
i.e., the valuation network, the cognitive control network, and the medial temporal lobe 
(imagery/prospection) network. EFT was related to brain regions including 
ventromedial prefrontal cortex (vmPFC), medial temporal lobe, and amygdala 
(Schacter et al., 2017). During EFT, the activation and connectivity between these 
regions are strengthened, which would reduce DD rate (Peters & Büchel, 2011). 
Specifically, one of the key regions is vmPFC, it is not only related to EFT, but also 
involved in valuation judgement and cognitive control (Hare, Camerer, & Rangel, 2009; 
Peters & Buechel, 2009). The vmPFC regulated connections among the three networks, 
specifically, vmPFC was involved in representation of future events during imagination, 
then vmPFC regulated the judgement of subjective value for delayed reward, in addition, 
vmPFC inspired the self-control ability and self-regulation to help individuals choose 
delayed option (Benoit et al., 2011; Jenkins & Hsu, 2017). Furthermore, Sasse et al. 
(2017) found that the functional connectivity between hippocampus and anterior 
cingulate cortex (ACC) was positively correlated with control capacity, while these two 
regions were activated during EFT (Schacter et al, 2017), these results further 


supported that EFT may regulate cognitive control to inhibit the impulsive choices 


(Sasse et al., 2017). 
Taken together, several hypotheses have been proposed on the underlying 
mechanisms of the effect of EFT on DD, these mechanisms may work together to 


reduce DD. 


EFT related moderators 

According to the present results, the majority of studies found EFT significantly 
reduced DD. However, several factors moderated this effect. One main factor is the 
valence of EFT. Positive EFT significantly reduced DD with a medium effect size 
(Bulley et al., 2019; Calluso, Tosoni, Cannito, & Committed, 2019; Zhang et al., 2018). 
Baumeister and Masicampo (2010) indicated that the EFT emotion may act as a 
"motivational brake", which means that the positive EFT helped individuals to 
counteract the impulsiveness of choosing the immediate option. The present results 
showed that negative or neutral EFT could not reduce DD rate. Though previous studies 
showed inconsistent findings on negative EFT and the number of studies involving 
negative EFT was small (Bulley et al., 2019; Calluso et al., 2019; Liu et al., 2013; Zhang 
et al., 2018), the results of moderator analysis (positive EFT reduced DD to a greater 
degree than EFT with valence not mentioned) provided indirect evidence that negative 
EFT would have a smaller effect in reducing DD rate, since in these studies did not 
mention the valence of EFT, participants may imagine neutral or negative future events, 
and these types of EFT showed a significantly smaller effect in reducing DD. These 


results suggested that positive EFT is essential in reducing DD. 


As to the method to elicit EFT, cue word task and time period task were most 
commonly used. Our results revealed that the time period task showed greater effect in 
DD reduction than the cue word task. One possible reason is that in studies adopting 
cue word task to elicit EFT, several studies used negative or neutral cue words to elicit 
EFT, thus negative or neutral EFT may be anticipated, while in studies adopting time 
period task, mostly studies require participants to imagine positive events in the given 
time period. As mentioned before, the valence of EFT was an essential factor 
moderating the efficiency of EFT in reducing DD. However, the present meta-analysis 
could not examine the interaction between EFT valence and method to elicit EFT, future 
studies are needed to compare these two methods directly. 

As to the context type of EFT, both personally related and task related EFT reduced 
DD to a similar degree. For the time distance of EFT, it was not related to the efficiency 
of EFT in reducing DD. One potential reason is that thinking about future events that 
might happen in a few months could broaden the time horizon to a similar degree to 
those in a few years, thus the effect on DD might be the same no matter how distant 
into the future they imagine. From the neural perspective, it might be whether 
participants imagine personal relevant events or task related events, whether they 
imagine relatively distant future or relatively recent future, they activated similar brain 
regions such as vmPFC and hippocampus (D'Argembeau, Xue, Lu, Van der Linden, & 
Bechara, 2008) and reduced DD to a similar degree (Benoit et al., 2011; Palombo et al., 


2015). 


Control task related moderators 

The present meta-analysis demonstrated that the characteristics of control task was 
not related to the efficiency of episodic recent thinking in reducing DD. There are 
several types of control task including no control task, episodic recent thinking, and 
other tasks such as story-telling or describing routine events (Calluso et al., 2019; 
Cheng et al., 2012; Hollis-Hansen et al., 2019). Compared with all types of control task, 
EFT showed similar and significant effect on DD. As for story-telling task, it controls 
individual's verbal ability and scene construction (Bulley & Gullo, 2017); episodic 
recent thinking requires individuals to vividly describe recent events, this task controls 
the scene construction and self-relevance (Hollis-Hansen et al., 2019). EFT reduced DD 
when taking these types of task as the control condition, suggesting that the EFT effect 
on DD was not confounded by context of control task (Bulley et al., 2016). 

As to the events recalled in the control task, the retrospective time period ranged 
from the past 24 hours to 3 years. The present results demonstrated that the time 
distance of the control task was not associated with the EFT effect (O'Donnell, Hollis- 
Hansen, & Epstein, 2018). Moreover, the valence of the control task did not influence 
the EFT effect either, it suggests that only the emotional valence of EFT is critical in 
reducing DD. Although we did not find any significant effect on moderators relating to 
control task, the standardization of control task is necessary when examining the 


efficiency of EFT on DD (Scholten et al., 2019). 


DD related moderators 


DD has been investigated with various tasks (Mok et al., 2020; Scholten et al., 2019). 
The present study examined several characteristics of the DD task. We found that EFT 
reduced DD to a larger degree in studies using hypothetical money reward than studies 
using potential real money reward, which is inconsistent with previous studies which 
suggesting both hypothetical and potential real rewards yielded similar effect of EFT in 
reducing DD (Lawyer, Schoepflin, Green, & Jenks, 2011; Madden, Begotka, Raiff, & 
Kastern, 2003; Madden et al., 2004). One possible reason is that when using potential 
real reward, the amount of reward was relatively small, while using hypothetical reward, 
the amount of reward can be larger, although the amount of reward did not show a 
significant effect (discussed below), there might be an interaction that could not be 
analyzed in this meta-analysis. Another factor needs to be mentioned is the number of 
the two types of studies has a large difference, almost 7596 studies used hypothetical 
reward, future studies need to focus more on potential real money reward to compare 
the effect of EFT on DD. 

The DD paradigm can be divided into two types, the fixed task in which the amount 
of reward is fixed, not influenced by participants’ choices, and the varied task in which 
the amount of reward changed according to participants’ responses, both paradigms 
showed similar significant reduction in DD by EFT (Bromberg et al., 2017; Jia et al., 
2020). In addition, whether the immediate reward was fixed or changed showed similar 
degree of DD reduction by EFT. These results suggested that the effect of EFT was 
stable. We found that fixed delayed reward showed a larger degree of EFT reduction 


than variable delayed reward. One possible reason is that individuals may be more 


sensitive to fixed delayed rewards than to variable rewards. Although there was a 
difference between the type of the delayed rewards, EFT reduced DD in a medium to 
large effect size with both fixed and variable delayed rewards. 

AUC and K related indexes are two main types of indexes of DD, the present results 
indicated that EFT reduced delay discounting using both AUC and K as indexes, 
consistent with Bromberg et al. (2017) and Hu et al. (2017). We also found that EFT 
had a larger effect on AUC than K related indexes, however, there is no study directly 
comparing the effect of EFT in reducing DD with different indexes (Hamilton et al., 
2015). Further studies are needed to examine the meaning and difference between AUC 
and K related indexes. 

Whether the amount of reward affect the effect of EFT on DD or not showed 
inconsistent findings. Some studies suggested that the amount of reward was not 
associated with the EFT effect (Jia et al., 2020; Kwan et al., 2012). However, Mok et 
al. (2020) found that the EFT effect was smaller when the amount of reward was large 
compared to small reward. The present results demonstrated that the effect of EFT in 
reducing DD was similar in small and large reward. One possible reason is related to 
the division of large and small amount, some studies suggest that over 2000 can be 
considered as large reward (Kuo, Lee, & Chiou, 2016; Mok et al., 2020), but the present 
study classified by 100 due to the limited number of studies using over 2000 as reward. 
Another factor should be considered is that studies conducted in different countries used 
different currency, it might be necessary to take exchange rate into consideration in the 


future when dividing large and small reward. 


Participants related moderators 

Very few studies have compared the effect of EFT in reducing DD across age groups. 
Sasse et al. (2017) indicated that EFT did not reduce DD in older groups, while Mok 
et al. (2020) indicated that the effect of EFT also reduced DD in older groups. The 
present results demonstrated that the effect of EFT in reducing DD was evident for all 
age groups including adolescent, young and older adults. Moreover, we found that 
EFT reduced DD in both healthy individuals and special populations, consistent to 
previous studies which suggested the EFT effect is widespread, involving different 
populations and ranging from financial reward to maladaptive behaviors (Dassen, 


Jansen, Nederkoorn, & Houben, 2016). 


Limitations and implications 

There are several limitations in the present study. First, even though we reviewed 
different models and potential mechanisms, the underlying mechanisms still need to be 
examined. Second, some studies considered other outcomes such as cigarette smoking, 
energy intake and alcohol demanding (Daniel et al., 2015; Stein et al., 2016), but the 
present study did not analyze these outcomes due to the limited number of studies. Third, 
studies have shown that episodic past thinking could also reduce DD (Lempert, Speer, 
Delgado, & Phelps, 2017), however, the number of studies were not enough to be 
included as a subgroup analysis. Further studies need to examine whether this effect is 


stable and whether there are differential effect of EFT and episodic past thinking in 


reducing DD. Fourth, most studies examined the effect of EFT on DD for gains, 
whether EFT could reduce DD for losses needs further investigation. Fifth, for several 
moderator analysis, the number of studies included in each subgroup were imbalanced, 
further studies are needed in several subgroups. For example, more studies are needed 
in the adolescent group, since adolescents are impulsive and showed large DD rate 
(Steinberg, 2008; White et al., 2014); more studies are needed in clinical patients, since 
increased DD rate is a transdiagnostic process in psychiatric disorders (Amlung et al., 
2019). 

Notwithstanding the above limitations, there are some implications of this study. First, 
EFT is an effective manipulation to reduce DD. One future direction is to apply this 
method in clinical populations with impulsive behaviors. Second, given that positive 
EFT had larger effect in reducing DD, when applying EFT, requiring participants to 


imagine future positive events is an optimal option. 
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Fig. 2 The forest plot of the overall effect of EFT on DD. 
Note: Con=Contrast; Stu= Study; HC-Healthy population; SCD-Subjective cognitive decline; Pos-Positive; Neu-Neutral; Neg=Negative; Past= Control task of recall past events; Standardized= 
Control task of Standardized episodic thinking; EFT = episodic future thinking; DD = delay discounting. 


Table 1 Descriptions of studies included in the meta-analysis 


Study Participan EFT Control EFT related moderators Control task related moderators DD related moderators Main 
ts group group results 
N (Age) N (Age) EFT EFT event EFT EFT Control Control Control DD Money Immedi Delayed DD Largest DD 
metho type valence longest event valence longest paradig type ate reward longest money index 
d days type days m type reward delay 
Benoit et HC 12 Cue Task-related 1 year Objectiv Fixed HYP Fixed Variable 1 year 65 LLR% | 
al. (2011) (27.3) word e usage DD 
Bromberg HC 44 (13- Time Personally Positive 7 Visual Variable PR DD Fixed Variable 7 50 AUC l 
etal: 16) period relevant and months perceptu months log k 
(2017) neutral al 
Bülley et HC 48 Time Personally Positive 1 year Story- Variable HYP Variable Fixed 1 year 10 AUC l 
al.(2017) (20.67) period relevant telling DD 
Bulléy et HC 99 101 (19.66) Cue Personally Positive Routine Neutral Fixed HYP Variable Variable 182 85 k l 
alp@019) (19.56) word relevant events DD days log K 
LLR% 
HC 97 Negative l 
(19.96) 
Calluso et HC 55 Time Personally Positive 6 No Fixed HYP Fixed Variable 6 60 AUC i 
al. (2019) (23.87) period relevant months DD months k 
Negative Fixed HYP Fixed Variable 6 60 AUC Jl 
DD months k 
Neutral Fixed HYP Fixed Variable 6 60 AUC l 
DD months k 
Cheng et HC 32 32 Time Personally Positive 4 years Routine Neutral Variable HYP Variable Variable 7 days 15 interes | 
al. (2012) (21.1) period relevant events DD t rate 
(96) 
Ciaramelli HC 59 Time Personally Positive 3 years Past Positive 3 years Variable HYP Variable Fixed 1 year 40 AUC l 
et al. (35.4) period relevant and event and DD 
(2019) neutral neutral 
Scene Variable HYP Variable Fixed 1 year 40 AUC J; 
DD 
Present Variable HYP Variable Fixed l year 40 AUC l 


DD 


Daniel et Obesity 48 Time Personally Positive 2 years Recent 24hours Variable HYP Variable Fixed 2 years 10 AUC 
al. HC period relevant event DD 100 
(20132) 
Daniel et Obesity 14 12 Time Personally Positive 2 years Recent 24 hours Variable HYP Variable Fixed 2 years 10 AUC 
al. period relevant event DD 100 
(2013b) 
Daniel et Obesity 21 21 (12.33) Time Personally Positive 6 Recent Positive 24 hours Variable HYP Variable Fixed 6 50 AUC 
al. (2015) (12.13) period relevant months event DD months 
Daniel et HC 27 27 Time Personally Positive 6 Recent Positive 24hours Variable HYP Variable Fixed 6 50 AUC 
al. (2016) period relevant months event DD months 
Dassen et HC 23 24 Time Personally 6 Recent 30days Fixed HYP Variable Variable 186 85 k 
al*(2016) period relevant months event DD days 
24 23 Time task related Routine Neutral Fixed HYP Variable Variable 186 85 k 
period events DD days 
Hollis- HC 18 (29) 18 (31.9) Time Personally Positive 1 year Recent 6 days Variable HYP Variable Fixed 2 years 100 AUC 
Hansen et period relevant event DD 
al. (2019) 
17 (27.4) Standar 
dized 
episodic 
thinking 
He etal. HC 24 Time Personally No Fixed HYP Fixed Variable 1 year 200 AUC 
(2047) (68.29) period relevant DD In k 
Subjective 20 Time Personally No Fixed HYP Fixed Variable — 1 year 200 AUC 
cognitive (68.29) period relevant DD In k 
decline 
Jia et al. SPD 30 33 (20.94) Time Personally Positive 1 year Recent Positive 24hours Variable HYP Variable Fixed 1 year 200 AUC 
(2020) (20.07) period relevant event DD 1000 
Lin et al. HC 45 42 (39.58) Cue Positive 6 Recent Positive 24 hours Fixed HYP Variable Variable 187 86 Ink 
(2014) (42.8) word and months event and DD days 
neutral neutral 
Liu et al. HC 32 Cue Personally Positive No Variable PRDD Variable Variable 30days 30 delaye 
(2013) (20.62) word relevant d 


HC 30 Cue Personally Neutral No Variable PR DD Variable Variable 30days 30 delaye 
(21.48) word relevant d 
rewar 
d 
HC 31 Cue Personally Negative No PR DD Variable Variable 30days 10-30 delaye 
(20.74) word relevant d 
rewar 
d 
Mok etal. HC 114 Cue Personally Positive No Variable HYP Variable Fixed 10 years 100 AUC 
(2020) word relevant and DD 2000 
neutral 
O'Donnell HC 52 52 (22.3) Time personal Positive 2 years Recent Positive 86hours Variable HYP Variable Fixed 2 years 100 AUC 
etal. (22.2) period goal event DD 
Q017) 
O'Donnell HC 80 (35) 80 (34) Time Personally Positive 2 years Recent Positive 86 hours Variable HYP Variable Fixed 2 years 100 AUC 
et al. period relevant event DD 
(2018) 
O'Donnell HC 22 20 (45.17) Time Personally Positive 2 years Recent Positive  86hours Variable HYP Variable Fixed 2 years 100 AUC 
et al. (41.54) period relevant event DD 
(2019) 
HC 18 18 (41.72) Time Personally Positive 2 years Recent Positive  86hours Variable HYP Variable Fixed 2 years 100 AUC 
(35.17) period relevant event DD 
Palombo Amnesia 9 Time task related 2 years No 2 years Fixed HYP Fixed Variable 2 years 58 LLR% 
et al. period DD 
(2015) 
HC 13 (65) Time task related 2 years No 2 years Fixed HYP Fixed Variable 2 years 58 LLR% 
period DD 
Palombo HC 12 Time task related 2 years No Fixed HYP Fixed Variable 3 years 59 LLR% 
et al. (60.2) period DD 
(2016) 
Peters et HC 30 (25) Time Personally 7 No Fixed PR DD Fixed Variable 233 170 log k 
al. (2010) period relevant months days 


Rung et HC 22 (33) 25 (34) Time Personally 1 year Recent 24hours Fixed HYP Variable Fixed 1 year 100 Ratio 
al. (2018) period relevant event DD of 
choos 
e 
larger 
rewar 
d 
Rung et HC 176 174 Time Personally Positive 5 years Recent 24hours Variable HYP Variable Fixed 1 year 100 IP 
al. (2019) period relevant event DD 
Sasse et HC 23 Time task related 190 No No Variable PR DD Fixed Variable 190 79.5 k 
al. (2015) (24.96) period days days 
Sasse'et HC 66.55(4. 22 Time task related 190 No No Variable PR DD Fixed Variable 190 79.5 k 
al. (2017) 02) period days days 
Snider et Alcoholic 25 (38) 25 (44.3) Time Personally Positive 1 year Past Positive 24hours Variable HYP Variable Fixed 1 year 100 AUC 
al*(2016) period relevant DD 
Sofisetal. | Cannabis 35.1 (9) 34.4 (10.5) Time Personally 1 year Past 24hours Variable HYP Fixed Variable 1 year 1000 AUC 
(2020) use period relevant DD 
disorder 
Stemret al. Smoker 20 22 (39.86) Time Personally Positive 1 year Recent 24hours Variable HYP Variable Fixed 1 year 1000 AUC 
(201 6) (38.65) period relevant event DD 
Stein.et al. HC 67 64 (34.79) Time Personally Positive 1 year Recent Positive 12days Variable HYP Variable Fixed 25 years 100 Ink 
(2017) (36.67) period relevant event DD 
Steineet al. HC 54 59 Time Personally Positive 1 year Recent Positive 12days Variable HYP Variable Fixed 25 years 100 Ink 
(20T8) period relevant event DD 
Szefet al. HC 33 33 Time Personally Positive 6 Recent Positive 6 days Fixed HYP Variable Variable 182 85 log k 
(2017) period relevant months event DD days 
HC 34 34 Time Personally Positive 6 Recent Positive 6 days Fixed HYP Variable Fixed 1 year 100 AUC 
period relevant months event DD 
Wu et al. HC 30 30 Time Personally Positive 1 year ideal l year Fixed PRDD Fixed Variable 1 year 240 k 
(2017) period relevant self 
30 Positive No Fixed PRDD Fixed Variable 1 year 240 k 
HC 30 30 Time Personally Positive 1 year unperso Fixed PRDD Fixed Variable 1 year 240 
period relevant nal EFT 


30 Positive routine Fixed PRDD Fixed Variable 1 year 240 k l 


event 
Zhang et HC 34 Cue Personally Positive No Fixed PRDD Fixed Variable log k l 
al. (2018) (21.53) word relevant 
32 Cue Personally Negative No Fixed PRDD Fixed Variable log k T 
(21.53) word relevant 
34 Cue Personally Neutral No Fixed PRDD Fixed Variable log k — 
(21.19) word relevant 


Note: EFT= Episodic future thinking; DD=Delay discounting; HC-Healthy population; HYP DD- Hypothetical delay discounting task; PR DD=Potentially real delay discounting task; LLR=Larger 
later reward; IP = Indifference points; | = delay discounting decreased; 1 = delay discounting increased; += No changes in delay discounting. 


Table 2 The effect of EFT related moderators on DD 


K d Z p 95% CI Q p Fail-safe N 

The EFT valence 
Positive 27 0.78 11.14 < 0.001 (0.64, 0.91) 2144 
Not particularly mentioned 12 0.44 6.52 < 0.001 (0.31, 0.57) 121 
Total between 12.09 0.001 

The'method to elicit EFT 
Cue word task 17 0.36 2.86 0.004 (0.11, 0.61) 255 
Time period task 27 0.72 9.34 « 0.001 (0.57, 0.87) 1808 
Fotal between 5.86 0.016 

The-context type of EFT 
Personally relevant 4] 0.59 8.4 « 0.001 (0.45, 0.73) 3250 
Task related 7 0.52 449 0.004 (0.29, 0.74) 38 
Total between 0.25 0.616 

Thelongest delay in EFT 
«180 days 7 0.75 7.14 « 0.001 (0.54, 0.95) 121 
180<X<365 days 17 0.7 7.33 « 0.001 (0.52, 0.90) 664 
>865 days 12 0.61 5.89 < 0.001 (0.41, 0.81) 257 
Total between 0.95 0.623 


Note=EFT = episodic future thinking; DD = delay discounting. 


Table 3 The effect of control task related moderators on DD 
Fail-safe N 


The control task valence 


Positive 
Not particularly mentioned 
Total between 

The context type of control task 
Past event 
No control task 
Other types 
Total between 

The longest time distance of control task 
x24 hours 
>24 hours 


Total between 


NotexDD = delay discounting. 


11 


0.55 
0.72 


8.04 
5.53 


95% CI 


(0.57, 0.93) 
(0.34, 0.69) 


(0.51, 0.82) 
(0.13, 0.68) 
(0.40, 0.80) 


(0.42, 0.69) 
(0.46, 0.97) 


516 
1469 


814 
315 
418 


126 
289 


Table 4 The effect of DD task related moderators on DD 


The DD money type 
Hypothetical money 
Potentially real money 
Total between 

The DD task type 
Fixed money 
Variable money 
Total between 

The immediate reward type 
Variable immediate reward 
Fixed immediate reward 
Total between 

The.delayed reward type 
Variable delayed reward 
Fixed delayed reward 
‘Total between 

The-outcome index of DD 
Area under curve 
K 
Total between 

TheJongest delay of DD 
«180 days 
180<X<365 days 

»365 days 
Total between 


The largest money reward of DD 


«100 
2100 
Total between 


Note: DD = delay discounting. 


K 


36 
12 


20 
28 


31 
17 


27 
21 


22 


19 


22 


25 
23 


0.52 
0.62 


0.65 
0.46 


0.42 
0.78 


0.73 
0.47 


0.45 
0.56 
0.79 


0.55 
0.68 


5.27 
7.12 


7.92 
4.19 


5.14 
8.37 


8.23 
4.88 


2.13 
8.68 
7.41 


5.97 
9.46 


p 


< 0.001 
0.087 


< 0.001 
< 0.001 


< 0.001 
< 0.001 


< 0.001 
< 0.001 


< 0.001 
< 0.001 


0.033 
< 0.001 
< 0.001 


< 0.001 
< 0.001 


95% CI 


(0.56, 0.81) 
(-0.04, 0.57) 


(0.32, 0.71) 
(0.45, 0.80) 


(0.49, 0.80) 
(0.24, 0.67) 


(0.26, 0.59) 
(0.60, 0.97) 


(0.55, 0.90) 
(0.28, 0.65) 


(0.04, 0.86) 
(0.43, 0.68) 
(0.58, 1.00) 


(0.37, 0.73) 
(0.54, 0.82) 


Q 


6.32 


0.68 


8.29 


4.21 


0.012 


0.411 


0.170 


0.004 


0.046 


0.122 


0.281 


Fail-safe N 


3157 
45 


474 
1719 


2131 
290 


700 
1352 


1329 
432 


58 
910 
627 


935 
1348 


Table 5 The effect of information of participants related moderators on reducing DD 


K 
The age of participants 
€ 40 years old 39 
>40 years old 9 
Total between 
The population of participants 
Healthy individuals 40 
Special populations 8 


Total between 


Note: DD = delay discounting. 


d 


0.58 
0.60 


0.59 
0.50 


Z 


7.96 
3.84 


8.06 
3.93 


p 


< 0.001 
< 0.001 


< 0.001 
« 0.001 


95% CI 


(0.43, 0.72) 
(0.29, 0.90) 


(0.45, 0.73) 
(0.25, 0.75) 


0.02 


0.35 


p Fail-safe N 
2631 
144 
0.898 
3059 
64 
0.556 


